Flexibility of representational states in working memory

The relationship between working memory (WM) and attention is a highly interdependent one, with evidence that attention determines the state in which items in WM are retained. Through focusing of attention, an item might be held in a more prioritized state, commonly termed as the focus of attention (FOA). The remaining items, although still retrievable, are considered to be in a different representational state. One means to bring an item into the FOA is to use retrospective cues (‘retro-cues’) which direct attention to one of the objects retained in WM. Alternatively, an item can enter a privileged state once attention is directed towards it through bottom-up influences (e.g. recency effect) or by performing an action on one of the retained items (‘incidental’ cueing). In all these cases, the item in the FOA is recalled with better accuracy compared to the other items in WM. Far less is known about the nature of the other items in WM and whether they can be flexibly manipulated in and out of the FOA. We present data from three types of experiments as well as transcranial magnetic stimulation to early visual cortex to manipulate the item inside FOA. Taken together, our results suggest that the context in which items are retained in WM matters. When an item remains behaviourally relevant, despite not being inside the FOA, re-focusing attention upon it can increase its recall precision. This suggests that a non-FOA item can be held in a state in which it can be later retrieved. However, if an item is rendered behaviourally unimportant because it is very unlikely to be probed, it cannot be brought back into the FOA, nor recalled with high precision. Under such conditions, some information appears to be irretrievably lost from WM. These findings, obtained from several different methods, demonstrate quite considerable flexibility with which items in WM can be represented depending upon context. They have important consequences for emerging state-dependent models of WM

Direct evidence for attention-dependent influences of the frontal eye-fields on feature-responsive visual cortex

Voluntary selective attention can prioritize different features in a visual scene. The frontal eye-fields (FEF) are one potential source of such feature-specific top-down signals, but causal evidence for influences on visual cortex (as was shown for "spatial" attention) has remained elusive. Here, we show that transcranial magnetic stimulation (TMS) applied to right FEF increased the blood oxygen level-dependent (BOLD) signals in visual areas processing "target feature" but not in "distracter feature"-processing regions. TMS-induced BOLD signals increase in motion-responsive visual cortex (MT+) when motion was attended in a display with moving dots superimposed on face stimuli, but in face-responsive fusiform area (FFA) when faces were attended to. These TMS effects on BOLD signal in both regions were negatively related to performance (on the motion task), supporting the behavioral relevance of this pathway. Our findings provide new causal evidence for the human FEF in the control of nonspatial "feature"-based attention, mediated by dynamic influences on feature-specific visual cortex that vary with the currently attended propert

Concurrent neuroimaging and neurostimulation reveals a causal role for dlPFC in coding of task-relevant information.

Dorsolateral prefrontal cortex (dlPFC) is proposed to drive brain-wide focus by biasing processing in favour of task-relevant information. A longstanding debate concerns whether this is achieved through enhancing processing of relevant information and/or by inhibiting irrelevant information. To address this, we applied transcranial magnetic stimulation (TMS) during fMRI, and tested for causal changes in information coding. Participants attended to one feature, whilst ignoring another feature, of a visual object. If dlPFC is necessary for facilitation, disruptive TMS should decrease coding of attended features. Conversely, if dlPFC is crucial for inhibition, TMS should increase coding of ignored features. Here, we show that TMS decreases coding of relevant information across frontoparietal cortex, and the impact is significantly stronger than any effect on irrelevant information, which is not statistically detectable. This provides causal evidence for a specific role of dlPFC in enhancing task-relevant representations and demonstrates the cognitive-neural insights possible with concurrent TMS-fMRI-MVPA

Concurrent neuroimaging and neurostimulation reveals a causal role for dlPFC in coding of task-relevant information.

Dorsolateral prefrontal cortex (dlPFC) is proposed to drive brain-wide focus by biasing processing in favour of task-relevant information. A longstanding debate concerns whether this is achieved through enhancing processing of relevant information and/or by inhibiting irrelevant information. To address this, we applied transcranial magnetic stimulation (TMS) during fMRI, and tested for causal changes in information coding. Participants attended to one feature, whilst ignoring another feature, of a visual object. If dlPFC is necessary for facilitation, disruptive TMS should decrease coding of attended features. Conversely, if dlPFC is crucial for inhibition, TMS should increase coding of ignored features. Here, we show that TMS decreases coding of relevant information across frontoparietal cortex, and the impact is significantly stronger than any effect on irrelevant information, which is not statistically detectable. This provides causal evidence for a specific role of dlPFC in enhancing task-relevant representations and demonstrates the cognitive-neural insights possible with concurrent TMS-fMRI-MVPA

Prefrontal control of familiarity and recollection in working memory

Left inferior frontal gyrus (IFG) is a critical neural substrate for the resolution of proactive interference (PI) in working memory. We hypothesized that left IFG achieves this by controlling the influence of familiarity- versus recollection-based information about memory probes. Consistent with this idea, we observed evidence for an early (200 msec)-peaking signal corresponding to memory probe familiarity and a late (500 msec)-resolving signal corresponding to full accrual of trial-related contextual ("recollection-based") information. Next, we applied brief trains of repetitive transcranial magnetic stimulation (rTMS) time locked to these mnemonic signals, to left IFG and to a control region. Only early rTMS of left IFG produced a modulation of the false alarm rate for high-PI probes. Additionally, the magnitude of this effect was predicted by individual differences in susceptibility to PI. These results suggest that left IFG-based control may bias the influence of familiarity- and recollection-based signals on recognition decisions

Repetitive transcranial magnetic stimulation dissociates working memory manipulation from retention functions in the prefrontal, but not posterior parietal, cortex

Understanding the contributions of the prefrontal cortex (PFC) to working memory is central to understanding the neural bases of high-level cognition. One question that remains controversial is whether the same areas of the dorsolateral PFC (dlPFC) that participate in the manipulation of information in working memory also contribute to its short-term retention (STR). We evaluated this question by first identifying, with functional magnetic resonance imaging (fMRI), brain areas involved in manipulation. Next, these areas were targeted with repetitive transcranial magnetic stimulation (rTMS) while subjects performed tasks requiring only the STR or the STR plus manipulation of information in working memory. fMRI indicated that manipulation-related activity was independent of retention-related activity in both the PFC and superior parietal lobule (SPL). rTMS, however, yielded a different pattern of results. Although rTMS of the dlPFC selectively disrupted manipulation, rTMS of the SPL disrupted manipulation and STR to the same extent. rTMS of the postcentral gyrus (a control region) had no effect on performance. The implications of these results are twofold. In the PFC, they are consistent with the view that this region contributes more importantly to the control of information in working memory than to its STR. In the SPL, they illustrate the importance of supplementing the fundamentally correlational data from neuroimaging with a disruptive method, which affords stronger inference about structure-function relations

Functional connectivity between prefrontal and parietal cortex drives visuospatial attention shifts

It is well established that the frontal eye-fields (FEF) in the dorsal attention network (DAN) guide top-down selective attention. In addition, converging evidence implies a causal role for the FEF in attention shifting, which is also known to recruit the ventral attention network (VAN) and fronto-striatal regions. To investigatethe causal influence of the FEF as (part of) a central hub between these networks, we applied thetaburst transcranial magnetic stimulation (TBS) off-line, combined with functional magnetic resonance (fMRI) during a cued visuo-spatial attention shifting paradigm. We found that TBS over the right FEF impaired performance on a visual discrimination task in both hemifields following attention shifts, while only left hemifield performance was affected when participants were cued to maintain the focus of attention. These effects recovered ca. 20 min post stimulation. Furthermore, particularly following attention shifts, TBS suppressed the neural signal in bilateral FEF, right inferior and superior parietal lobule (IPL/SPL) and bilateral supramarginal gyri (SMG). Immediately post stimulation, functional connectivity was impaired between right FEF and right SMG as well as right putamen. Importantly, the extent of decreased connectivity between right FEF and right SMG correlated with behavioural impairment following attention shifts. The main finding of this study demonstrates that influences from right FEF on SMG in the ventral attention network causally underly attention shifts, presumably by enabling disengagement from the current focus of attention

Environmental factors and features that influence visual search in a 3D WIMP interface

The challenge of moving past the classic Window Icons Menus Pointer (WIMP) interface, i.e. by turning it ‘3D’, has resulted in much research and development. To evaluate the impact of 3D on the ‘finding a target picture in a folder’ task, we built a 3D WIMP interface that allowed the systematic manipulation of visual depth, visual aides, semantic category distribution of targets versus non-targets; and the detailed measurement of lower-level stimuli features. Across two separate experiments, one large sample web-based experiment, to understand associations, and one controlled lab environment, using eye tracking to understand user focus, we investigated how visual depth, use of visual aides, use of semantic categories, and lower-level stimuli features (i.e. contrast, colour and luminance) impact how successfully participants are able to search for, and detect, the target image. Moreover in the lab-based experiment, we captured pupillometry measurements to allow consideration of the influence of increasing cognitive load as a result of either an increasing number of items on the screen, or due to the inclusion of visual depth. Our findings showed that increasing the visible layers of depth, and inclusion of converging lines, did not impact target detection times, errors, or failure rates. Low-level features, including colour, luminance, and number of edges, did correlate with differences in target detection times, errors, and failure rates. Our results also revealed that semantic sorting algorithms significantly decreased target detection times. Increased semantic contrasts between a target and its neighbours correlated with an increase in detection errors. Finally, pupillometric data did not provide evidence of any correlation between the number of visible layers of depth and pupil size, however, using structural equation modelling, we demonstrated that cognitive load does influence detection failure rates when there is luminance contrasts between the target and its surrounding neighbours. Results suggest that WIMP interaction designers should consider stimulus-driven factors, which were shown to influence the efficiency with which a target icon can be found in a 3D WIMP interface

The neural bases of the short-term storage of verbal information are anatomically variable across individuals

What are the precise brain regions supporting the short-term retention of verbal information? A previous functional magnetic resonance imaging (fMRI) study suggested that they may be topographically variable across individuals, occurring, in most, in regions posterior to prefrontal cortex (PFC), and that detection of these regions may be best suited to a single-subject (SS) approach to fMRI analysis (Feredoes and Postle, 2007). In contrast, other studies using spatially normalized group-averaged (SNGA) analyses have localized storage-related activity to PFC. To evaluate the necessity of the regions identified by these two methods, we applied repetitive transcranial magnetic stimulation (rTMS) to SS- and SNGA-identified regions throughout the retention period of a delayed letter-recognition task. Results indicated that rTMS targeting SS analysis-identified regions of left perisylvian and sensorimotor cortex impaired performance, whereas rTMS targeting the SNGA-identified region of left caudal PFC had no effect on performance. Our results support the view that the short-term retention of verbal information can be supported by regions associated with acoustic, lexical, phonological, and speech-based representation of information. They also suggest that the brain bases of some cognitive functions may be better detected by SS than by SNGA approaches to fMRI data analysis